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COMPUTER INTERFACE EXTENSION SYSTEM AND METHOD 



Field of the Invention 

5 

The present invention relates to an 
input -output system for a computer and more specifically 
to an interface extension system which permits a PC to 
be utilized and controlled from the location of a 
10 television receiver. 

Background of the Invention 

Moderately priced general purpose 

15 micro -computers, i.e, PCs, have recently moved beyond 
their erstwhile roles as home financial and educational 
tools to become sophisticated multimedia entertainment 
systems and, with increasingly available Internet 
access, are poised to become an important forum for the 
20 direct home marketing of goods and services. In 
addition, games designed to be executed on PCs are 
rapidly overtaking games designed for specific game 
consoles such as Nintendo® and Sega Genesis®. These 
recent developments are influencing many people to 
25 install a computing base in their primary entertainment 
room, e.g. a living room or family room. 

Both the PC and the television industry have 
responded to these developments by offering living room 
computing systems. The offerings by the PC industry 
3 0 reflect desire on the part of PC manufacturers to make 
inroads into the traditional domain of television 
makers. One such recently introduced PC system is the 
Destination® system offered by Gateway 2000, Inc. The 
Destination system is a high resolution, large screen PC 
35 which is optimized for use in locations where a TV 
receiver has traditionally been used. The Destination 
system incorporates a "high end," albeit conventional, 
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PC having a high perf oirmance microprocessor, CD-ROM 
drive, sound and video processing cards, and disc 
storage drives and is equipped with a wireless pointing 
device (mouse) and an available wireless keyboard- In 
5 addition, the large screen monitor of the Destination 
system displays images at higher resolution than 
conventional large screen TV displays. Having these 
features, the Destination system permits users to 
operate a full function PC system and to browse Internet 

10 sites (i.e., to "websurf") from a sofa located within 
viewing range of the large screen PC system. In 
addition to the Destination system, the 'Genius' system 
offered by Thomson Electronics has a similar 
construction and need not be described in further detail 

15 here. 

Another recently developed PC system is the 
'Simply Interactive PC (TM) reference specification 
adopted and advanced by Microsoft, Inc. for combination 
PC - television systems. Under that Specification, the 

20 PC generates a video display signal and converts it to a 
television scan format such as NTSC, to permit the 
display signal to be viewed on a television receiver. 
The Specification provides minimal standards for 
processor and memory capacity, but requires the system 

25 to include a modem and network protocol support to 
provide a basic Internet browsing function. Finally, 
the Specification requires the PC to have 'instant on' 
operation; that is, the PC must appear to have no boot 
cycle from the viewpoint of the user when it is turned 

30 on. 

The foregoing described Gateway Destination and 
Thomson Genius systems share a common disadvantage in 
that each of those systems is marketed as a high end 
(and consequently expensive) PC system to be used 
3 5 primarily in places (e.g. the living room or family 
room) where a less expensive TV receiver has 
traditionally been used. In the past, TV receivers and 
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PCs have been used in the living room or family room 
primarily for children's oriented activities such as 
game-playing. Activities requiring greater concentra- 
tion such as home financial management and word 
5 processing have traditionally been performed, on a PC 
located away from the living room in a bedroom or home 
office. Since both up-to-date game applications and 
popular finance and word processing applications require 
relatively high end PC systems, users who wish to 

10 benefit from such applications must keep current by 
purchasing relatively high end PCs. Finally, since 
there is no reason to expect that users will choose to 
conduct all computing activities from a PC located in 
their living rooms, the new Destination and Genius 

15 systems would require a family to purchase two 
relatively high end systems in order to perform the full 
range of their traditional home computing activities. 
For these reasons, the new living room based PCs result 
in substantial added costs which ultimately limit their 

2 0 attractiveness . 

The currently available alternative is also 
undesirable. Although systems which conform to the 
Simply Interactive PC specification reduce the cost of 
living room based computing, such systems represent 
25 substantial compromises in PC functionality and 
performance. There remains an unsatisfied need for a 
system which reduces the cost of PC computing, performed 
in the living room without reducing the operational 
capabilities of such computing. 

The present invention fills this need by 
extending the user interface of a PC located in one 
location (such as a home office) to another location 
where a television (TV) receiver is located. The 
present invention extends the user interface by 

3 5 converting the PC generated video display signal to a 

scan format which can be displayed on the TV receiver 
and transmitting the video display signal and/or PC 
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generated audio signals from the PC location to the TV 
receiver location. The interface extender system also 
incorporates a device located at the TV receiver which 
receives user command and pointing device input data and 
5 couples that input data to the PC via an available radio 
freqpaency transmission channel which may be wireless or 
utilize existing wiring such as the AC wiring within a 
house . 

The present invention is not without its 
10 antecedents. U.S. Patent No. 3,618,035 shows a system 
in which the output of a computer 150 (FIG. 1) is 
connected to a data translator and synchronizer 134 such 
that video signals are transmitted via a switching 
system 13 0 to a "standard video- telephone station" 
15 (e.g., subscriber station 100a) having a video display 
screen 112. A subscriber located at the video-telephone 
station uses a light pen 122 to transmit control signals 
to the computer 150 and thereby control what he sees on 
the display. 

20 U.S. Patent No. 3,569,617 shows a system in 

which a time-sharing computer 10 (FIG. 1) is coupled via 
a data interpreter 2 0 to a scan converter 31 which in 
turn is coupled to a video signal distributor 32 which 
records video output signals corresponding to respective 

25 users' time-shares on a video disk 33. Information 
stored on video disk 3 3 is then transmitted to a 
plurality of conventional television receivers 60 for 
viewing by each user. As in U.S. Patent No. 3,618,035, 
described above, users located at the television 

3 0 receivers use a light pen 4 0 to interact with the 
displayed video and transmit control signals back to the 
computer 10. 

The systems taught in the above -described '035 
and '617 Patents, while permitting user input to be 
3^ transmitted to the computer from the location of a 
remote computer, fall short of extending the user 
interface of a computer system, especially a PC, in 



wo 98/16065 



PCT/US97/17753 



substantially unaltered condition to permit a user at a 
TV receiver to effect substantially the same level of 
control over the PC as when the user is at the PC 
location. 

5 Accordingly, it is an object of the present 

invention to extend the user interface of a PC from the 
location of said PC to the location of a television (TV) 
receiver remote from said PC. 

It is another object of the invention to 
10 provide a system which couples command and pointing 
device input data generated at a remote video display 
(e.g. TV receiver) location to a PC in an input format 
recognized by the PC. 

A further object of the invention is to provide 
15 control over the operations of a PC from the location of 
a remote TV receiver by transmitting PC recognized input 
data over a wireless transmission medium or over 
available parallel conductor or twisted pair conductor 
transmission lines . 

Still another object of the invention is to 
provide a low cost and easily managed transmission 
channel for transmitting a full motion PC display and PC 
generated audio signals from the PC to the remote 
location of a TV. 

Still another object of the invention is to 
provide utilization of and control over a PC from a 
remote location by launching a multiple instruction 
program from the remote location which provides 
macro- level control over PC. 

Another object of the invention is to provide a 
system which multiplies the user interface of a PC to 
provide multiple simultaneous interactive sessions on 
such PC which are controlled independently by users 
located at each of a plurality of video displays. 

Still another object of the invention is to 
permit a television transmission to be viewed in 
conjunction with related PC generated display and/or 
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audio signals by extracting an embedded address from the 
TV transmission and accessing related data through the 
extracted address for generating the related display 
and/or audio signal by the PC. 

5 

Summary Of The Invention 

These and other objects are provided by the 
computer interface extension system and method of the 
10 present invention. In accordance with the present 
invention, a system is provided which extends the user 
interface of a PC from the location of the PC to the 
location of a television (TV) receiver at a remote 
location. 

15 A computer user interface, especially a PC user 

interface, is defined by a video display and/or one or 
more audio signals which vairy in response to user input 
received and recognized by the computer. As used 
herein the term "video display" includes an associated 

20 audio presentation, as for example available from a 
multi -media computer. While a great variety of 

signalling methods have been used in the past (e.g. 
light -pen and punched card) for providing user input to 
various computing systems, virtually all computers 

2 5 purchased by individuals today for home use are PCs 

which accept digitally encoded input data from keyboards 
and pointing devices. Recent advances in PC technology 
provide new methods for the PC to acquire input data. 
These include facsimile transmission, sound acquisition 
^0 through sound cards, image acquisition through 
digitizing video camera systems and document scanners, 
and systems which optically recognize scanned document 
character input or voice commands. While all such 
signalling methods permit some level of control to be 

3 5 asserted over a computer, the primary and preferred 

signalling methods at present and for the foreseeable 
future are those which cause the location of a pointer 
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to move relative to a PC generated video display (e.g. a 
mouse) or through which the user can select characters 
to appear upon the video display (e.g. a keyboard). The 
present invention seeks to permit these primary 
5 signalling methods to be used at locations more distant 
from the PC than existing PCs permit. In addition, the 
present invention provides a system by which other 
non-primary signalling methods (e.g. video camera 
signals) can be transmitted and coupled to the PC from 

10 the remote location. 

Accordingly, the computer interface extension 
system according to an embodiment of the present 
invention incorporates a scan converter for converting 
the PC video display signal from a PC scan format to a 

15 TV scan format to permit the PC video display to be 
received and viewed on the TV receiver. A transmitter 
is also incorporated which transmits a signal 
representing a PC video display and PC generated audio 
signals, if any, from the location of the PC to the 

20 location of a remote TV receiver. In addition, the 
interface extension system includes an input interface 
extender which is used to couple user input generated at 
the TV receiver location, including command input and/or 
pointing device input, to a PC in a format recognized by 

25 the PC. 

With the interface extension system of the 
present invention, all PC operations which do not 
require the manual interchange of storage media can be 
initiated and controlled from the location of the TV 

3 0 receiver through user input provided to the input 
interface extender, thus permitting the remotely located 
PC to be fully utilized at the TV receiver location. 

Data and video display information interchange 
is accomplished by the present invention in the 

35 following manner. Preferably, in order to conserve 
system bandwidth, the PC scan format display signal is 
converted through a scan converter located at the PC and 
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then transmitted as a conventional television signal 
(e.g. NTSC format) from the PC location to the location 
of the TV receiver. Alternatively, when system bandwith 
considerations are less important, the scan converter 
5 can be located at the TV receiver location such that the 
PC video display signal is transmitted in an available 
PC scan format to the TV receiver location and then 
converted to a TV scan format for viewing on the TV 
receiver. Preferably, in a first embodiment, the PC 

10 video display signal is transmitted from the PC location 
to the TV receiver location as a modulated radio 
frequency or microwave wave signal over the air. In 
another preferred embodiment, the PC video display 
signal is transmitted from the PC location to a head end 

15 location of a radio frequency transmission line such as 
a coaxial cable, which couples the transmitted signal to 
the TV receiver. Preferably, when transmitted to such 
head end location, the PC video display signal is 
converted to the TV scan format prior to transmission. 

20 While the converted display signal and any accompanying 
audio signals are preferably transmitted over the air 
from the PC location to the head end location, such 
signals might also be transmitted via a radio frequency 
transmission line from the PC location to the head end 

25 location, 

Another embodiment of the present invention 
permits the user interface of a PC to be multiplied so 
as to provide multiple simultaneous independently 
controlled interactive sessions providing video and 
^0 accompanying audio signals, when present, to users 
located at each of a plurality of video displays (e.g. 
TV receivers) . In this embodiment, input interface 
extenders are located at each of the video displays. In 
* order to permit the input data generated by the input 
interface extenders to control only selected ones of the 
interactive sessions, each input interface extender tags 
the input data it generates with a unique identifier. 
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In another embodiment of the invention, the 
input interface extender incorporates at least one 
multiple instruction program for providing macro- level 
control over the operations of the PC. Preferably, the 
5 multiple instruction program controls the PC operations 
without regard to the application being executed on the 
PC, and preferably irrespective of the architecture of 
the micro-processor or operating system elements of the 
PC. In a highly preferred embodiment, the program 

10 included in the input interface extender is structured 
to re -configure the PC video display to provide improved 
viewing on the TV receiver. Such program may be 
launched for execution on the PC by a "run" button or 
other simple input device at the TV receiver location, 

15 Finally, in still another . embodiment of the 

invention, a system is provided which permits a 
television transmission to be viewed in association with 
a related PC generated display signal and accompanying 
audio signals, if any, on a TV receiver remote from the 

2 0 PC. In this embodiment, an embedded address is 

extracted from the television transmission, at which 
address data related to the television transmission can 
be accessed by the PC. The system includes an 
activating device (e.g. a pushbutton switch) which 
25 responds to user input at the TV receiver to prompt the 
PC to access the related data using the extracted 
address. The system provides the related data as a 
displayable signal and accompanying audio signal, if 
any, to the TV by generating a display signal and any 
accompanying audio signals at the PC location, 
converting the video display signal from a PC scan 
format to a TV scan format, and locally transmitting the 
display signal and any accompanying audio signals from 
the PC location to the TV receiver. Preferably, the 

3 5 related PC generated display signal is provided on the 

TV receiver in a picture-in-picture display format. 
Preferably, the system also provides a way of rapidly, 
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directly, and automatiGally switching the TV receiver 
display between the transmitted television signal and 
the related PC display rsignal . Preferably, the system 
also provides positive indication to the viewer when an 
5 embedded address is available for extraction from the 
television transmission, and also indicates when the PC 
receives such related data to be displayed. 



Brief Descriptions Of The Drawings 

10 

FIG. 1 is a block diagram showing the general 
construction and interaction between components of the 
computer interface extension system of the present 
invention. 

15 FIG. la is a block diagram illustrating the 

construction of a PC interface unit portion of the 
computer interface extension system. 

FIG. lb is a block diagram illustrating the 
construction of a head end unit portion of the computer 
20 interface extension system. 

FIG. ic is a block diagram illustrating the 
construction of transceiver and input interface extender 
components of the computer interface extension system. 

FIG. 2 is a flowchart illustrating video signal 
2 5 processing operations performed by the invention. 

FIG. 3a illustrates the placement of system 
components with respect to a TV receiver in a system 
constructed according to the first embodiment of the 
invention. 

FIG. 3b illustrates the placement and 
interconnection of system components with respect to a 
TV receiver in a system constructed according to another 
embodiment of the invention. 

FIG. 3c illustrates the placement and 
^5 interconnection of system components with respect to a 
plurality of TV receivers in a system constructed 
according to yet another embodiment of the invention. 
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FIG. 3d illustrates the placement and 
interconnection of system components with respect to a 
TV in a system constructed according to yet another 
embodiment of the invention. 
5 FIG. 4 is a block and schematic diagram 

illustrating the construction and operations of the 
input interface extender and video signal conversion and 
transmission portions of the present invention. 

10 Detailed Description Of The Preferred Embodiments 

FIG. 1 shows the constoruction of a first 
embodiment of the computer interface extension system of 
the present invention and the general interconnection of 

15 the invention with a PC and a conventional TV receiver. 
In the exemplary embodiment shown in FIG. 1, the 
invention is embodied in a PC interface unit 10 which 
incorporates a video scan format converter and a 
transceiver 12 coupled to the PC for transmitting the PC 

2 0 video display signal (including audio) to the location 
of the TV receiver via radio frequency or microwave 
frequency. 

In the embodiment shown in FIG. 1, the video 
scan format converter (shown in more detail in FIG. la) 

2 5 converts the scan format of the PC video display signal 

from that generated by the PC to a scan format suitable 
for displaying upon the TV receiver indicated by 
reference numeral 4 . Left and right audio channel data 
are also provided from PC 2 through PC interface unit 10 
to transceiver 12 to be transmitted via radio frequency 
or microwave frequency to a corresponding transceiver 14 
located at the TV receiver 4 . 

Transceiver 14 receives and ' demodulates the 
transmitted PC video and audio channel signals and 

3 5 outputs a composite video signal 16 and left and right 

audio channel signals 18 to TV receiver 4, 
Alternatively, transceiver 14 provides a radio frequency 
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(RF) input to TV receiver 4 which contains the composite 
video signal and the left and right audio channels 
signals. Using the thus received audio and video 
channel signals, the TV receiver 4 displays -the PC 
5 generated video in a compatible TV scan format and 
processes the received left and right audio channel 
signals for output to speakers 20 which may be 
integrated into the TV receiver 4 or connected thereto. 

As shown in FIG. 1 the interface extension 

10 system incorporates a ' backchannel ' 21 for transmitting 
input data received at the location of the TV receiver 
to the location of the PC interface unit 10. Modulated 
input data received at the location of the TV receiver 
is transmitted on backchannel 21 along an available 

15 transmission medium such as wireless radio frequency 
transmission or tranmission via the AC wiring which 
extends between the location of the PC 2 and the TV 
receiver 4 . Those skilled in the art will understand 
that several different transmission media are available 

20 which are suitable for locally transmitting data within 
a limited area, which include media relying on 
electromagnetic radiation such as wireless radio 
frequency, microwave, and infrared transmission, as well 
as guided transmission media which utilize either 

25 dedicated or multi-use transmission lines (e.g. parallel 
conductor, twisted pair and coaxial cable lines) and/or 
optical fiber lines. Transceivers 22 and 12 (FIGS, la 
and Ic incorporated into the interface extension system 
or operating in conjunction therewith, are designed to 

^0 transmit information through the available transmission 
medium, e.g. wireless radio frequency transmission. 
When the transmission medium is current carrying AC 
wiring, transceivers 22 and 12 are implemented as modems 
which operate, for example, according to a known 
standard such as CEBus . 

User input is received from the location of the 
TV receiver 4 through a input interface extender 2 6 , 
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shown, for example, as a Universal Serial Bus (USB) 
standard hub. The Universal Serial Bus is a recently 
introduced system standard which permits input data from 
typical input devices such as a keyboards, mice, 
5 joysticks, as well as more recently introduced input 
devices, e.g. microphones, to be transmitted along a 
single serial transmission line into a USB input port of 
the PC. The USB Standard permits devices having USB 
output interfaces to connect to a USB transmission line 

10 by simply connecting the output lines of the devices to 
either a USB transmission line or to the output line of 
any other USB compatible device which is connected to 
the USB input port of the PC. In addition, the USB 
Standard provides for USB hubs which control USB traffic 

15 in two directions along USB transmission lines. Thus, 
the input interface extender 26, when implemented with a 
USB hub device receives keyboard, mouse, joystick, and 
microphone input data and transmits that data as 
multiplexed serialized packet data through transmitter 

2 0 22 along backchannel 21 through receiver 12 to PC 
interface unit 10 connected to PC 2 . The input 
interface extender 26 further identifies and receives 
serialized data incoming from backchannel 21 for use at 
the user location, e.g. audio channel data for output 

25 via wireless infrared link to IR headphone 28. 

It will be appreciated that the USB 
transmission protocol is an open standard which permits 
new input device systems to be added as they become 
available. Thus, retinal tracking devices and 

^0 electronic gloves such as those used in virtual reality 
applications are among the many different types of input 
devices which could be used with the present invention. 
Such input devices may have standard, hardwired * serial 
or parallel data interfaces, or may belong to a newer 
class of input devices which allow short range wireless 
data transmission and may operate according to 
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traditional standards . PS/2®, RS-232 or the more 

recent USB standard, 

FIG. la is a:, block diagram showing the 
construction of a PC interface unit 10 portion of the 
5 computer interface extension system, for use at the 
location of the PC. As shown in FIG. la, PC interface 
unit 10 is coupled to PC 2 .through interface lines as 
follows: "VGA" through which PC video display output is 
received; and "Audio" through which PC audio output is 

10 received- Input is provided to the PC through signal 
interfaces "USB" , "Mouse" , "Keyboard" , "Joystick" , 
"Serial" and "Mic" as multiplexed data from respective 
input devices including joystick 29c and joystick 2 7c 
(FIG. Ic) , keyboard 29a and keyboard 27a (FIG. la) , 

15 mouse 2 9b and mouse 27b, microphone 2 9d and microphone 
27d, and any USB device which is directly connected into 
USB transmission line 30. 

PC interface unit 10 incorporates the following 
elements. Processor 32 is used to receive VGA video 

2 0 output from the PC and distribute that signal in 
original form to a video display 2a. Processor 32 is 
also used to distribute PC audio signals in original 
form to a pair of speakers (not shown) for output at the 
PC thereon . PC interface unit 10 also incorporates a 

2 5 microcontroller 34 which is used to guide the flow of 
incoming signals from input devices 29a - 29d to PC 2 in 
conjunction with multiplexed serial data arriving 
through a backchannel 21, or through USB transmission 
line 30. Coplexor unit 36, is designed to multiplex two 

^0 signals from each type of input device, e.g. joystick 
27c, located at the TV receiver location, and joystick 
29c, located at the PC location, onto a single standard 
input interface, e.g. "Joystick" interface shown at the 
input to PC 2. Coplexor 3 6 permits the interface 

35 extension system of the present invention to be used 
with existing PCs and input devices which do not 
incorporate USB standard interfaces. As contemplated in 
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the present invention, coplexor 36 would incorporate a 
plurality of standard PC interface connections for 
receiving input from existing PC input devices, i.e. 
those indicated by reference numerals 29a through 2 9d. 
5 PC interface unit 10 also incorporates a USB 

hub 16 for multiplexing USB data received at the PC 
location, e.g. through USB transmission line 30, and as 
received from the TV receiver location, i.e. through 
backchannel 21. Finally, PC interface unit 10 
10 incorporates a scan converter 4 0 for converting the PC 
video display signal from the PC scan format, e.g. from 
VGA or SVGA format to a television scan format, e.g. 
NTSC. 

Coupled to the output of PC interface unit 10 

15 is a transceiver 12 used to modulate and transmit the 
converted PC video display signal via radio frequency or 
microwave frecjuency over the air from the PC location to 
the TV receiver location. 

FIG. lb is a block diagram illustrating the 

20 construction of a head end unit portion 50 of the 
computer interface extension system. Referring to FIG. 
lb, head end unit 50 is used at the head end of a local 
(e.g. household) cable distribution system to couple 
video signals generated and transmitted from the PC onto 

25 the local cable system for distribution to different 
rooms or areas as within a house. The head end unit 50 
would ordinarily be located in a basement or a garage 
where the incoming cable is distributed to different 
rooms. As shown in FIG. lb, head end unit 50 includes 

3 0 an antenna 52 for receiving a transmitted radio 
frequency or microwave frequency signal from the PC 
location, which signal contains video and audio signal 
information generated by the PC. Those skilled in the 
art will appreciate that a number of alternatives exist 

35 for transmitting the signal from the PC location to the 
head end unit, among which are various hardwired methods 
including radio frequency transmission on a separate 
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coaxial cable from the PC location to the head end unit 
50 . 

Head end unit 50 includes a receiver 54 for 
detecting and receiving the transmitted video and audio 
5 signals from the PC. The receiver 54 is coupled to a 
converter 56 which converts the received signal from the 
transmitted frequency to a frequency selected by a 
frequency agile modulator 58 and described in the 
following. Head end unit 50 also includes a frequency 

10 agile modulator (FAM) 58. The FAM 58 is used to locate 
available, i.e., unused, frequencies on the incoming 
CATV cable and to modulate signals, i.e. PC video and 
audio signals received by receiver 54, onto one or more 
of those otherwise unused channels to permit the FAM 

15 modulated signals to be combined with the existing 
signals on the cable system through a combiner 60 on to 
a single cable 61 for local distribution, for example, 
within a house. Head end unit 50 additionally 
incorporates a combiner 6 0 which combines the modulated 

2 0 signal output of FAM 58 with the available cable channel 
signals from incoming cable 62 onto one or more cables 
61 used for local distribution. Head end unit 50 also 
incorporates a transceiver unit 63 used to receive 
backchannel data from input devices located at one or 

25 more receivers and to transmit such data on an available 
transmission medium, e.g. via wireless radio frequency 
transmission, or via the AC wiring of a house, to a PC 2 . 

Referring to FIG. ic, the portion of the 
interface extension system located at the TV receiver 

2 0 location will now be described. As shown in FIG. Ic, 
transmitted signals arriving over the air at antenna 15 
or local cable 61 (optionally through set top box 76) 
are received at transceiver 14. In addition, the output 
of an optional video camera 19 can be coupled to 

^5 transceiver 14 for transmission to PC 2 through PC 
interface unit 10 (FIG. la). Transceiver 14 receives 
the transmitted PC audio and video signals and couples 
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them to TV receiver 4 as composite video 16, audio left 
and right channel information 18, or as a radio 
frequency signal 25 . 

As shown in FIG. Ic, a input interface extender 
5 26 is connected to input devices including joystick 2 7c, 
keyboard 27a, mouse 27b, microphone 27dv and telephone 
27e. Input interface extender 26 is also coupled to an 
available backchannel 21, illustrated representatively 
as the AC "wiring system accessed through power outlet 23, 

10 In this exemplary embodiment of the invention, 

input interface extender 26 includes a USB hub 64 used 
to control the communication of data generated by input 
devices 27a through 27e, through a USB standard 
transmission protocol. A modem 22 used for transmitting 

15 and receiving signals via wireless single sideband radio 
frequency or via carrier current on conductors is also 
included within input interface extender 26. 

As described in the foregoing, there is no 
requirement that the backchannel 21 be implemented as a 

20 transmission line, such as via the AC wiring system of a 
house. For example, signals can be transmitted via 
electromagnetic radiation (e.g. radio frequency, 
microwave frequency or infrared radiation) from the 
location of the TV receiver to the PC without requiring 

25 the use of a transmission line between the two 
locations. As further shown in FIG. Ic, input interface 
extender 2 6 includes circuitry 6 6 for receiving input 
data from "LEGACY", i.e. non-USB, input devices 27a 
through 27e and converting that input data to a format 
suitable for transmission according to USB transmission 
protocol. Further circuitry 68 is used to attach 
standard USB identifiers to the converted signals for 
transmission on USB bus 65. 

As also shown in FIG . Ic , input interface 
extender 26 may include one or more function buttons 70 
for automatically activating functions which vary the 
operation of the PC as well as the operation of other 
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parts of the interface extension system. Function 
buttons 70 can operate hardwired functions within input 
interface extender 26, or "launch" single or multiple 
instruction programs to be accessed and executed on 
5 input interface extender 26 or to be transmitted via 
backchannel 21- through PC interface unit 10 to PC 2 to 
be executed thereon . 

A programming instruction language known as 
Java® has been developed which is designed to operate 

10 independently of the processor implementation (i.e. the 
"microprocessor" element of a PC) or the operating 
system (e.g. DOS, OS/2®, or Apple®) which resides on 
the PC. In the exemplary embodiment of the invention 
described herein, such multiple instruction programs, 

15 called "Micro applications" reside at the input 
interface extender 26 and may be launched therefrom to 
the PC interface unit 10 at the touch of a function 
button 70 or other simple input from any one of the 
various input devices 27a through 27e. Finally, input 

20 interface extender 26 includes an 8 -bit, 16 -bit, or 
3 2 -bit microcontroller 74 which controls its operations, 
including the flow of USB data traffic to and from input 
interface extender 26. 

FIG. 2 is a flow chart illustrating the video 

2 5 signal processing operations performed in a 
representative embodiment of the present invention. As 
shown in FIG. 2, video signals received from PC 2 are 
first digitally (i.e. "computer") processed to provide 
selected viewing conditions, e.g. zoom, pan, or scan 

^0 which may be default selected or selected by the user 
through input provided at input interface extender 26. 
The processed video is then converted (in step 2 03) from 
a PC scan format (e.g. VGA) to a television format (e.g. 
NTSC) . The converted video signal is then modulated 

3^ (step 2 05) via a suitable method, e.g. amplitude 
modulation, frequency modulation, or spread spectrum, 
and then transmitted (step 207) at a radio frequency 
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(e.g. 900MHz ) or microwave frequency (e.g. 2.4 GHz) over 
the air from the PC location via transceiver 12 . 

At the head end location of the local cable 
system, (such as the garage of as in a house) the 
5 transmitted video signal is received (step 209) and 
converted (step 211) to a frequency identified by a 
frequency agile modulator 58 as being available. The 
converted frequency signals are then combined, in step 
213, and distributed in step 215 through one or more 

10 local cables 61 to TV receivers 4 . The distributed 
cable signals are then received at transceivers 14 
located at respective TV receivers 4, demodulated 
thereat (step 217) , and provided to respective TV 
receivers 4 for display in a television scan format such 

15 as NTSC (step 219) . 

The operations of the interface extension 
system will now be described with reference to FIGS. 1, 
and la through Ic. When a user located within viewing 
distance of TV receiver 4 at a location (e.g. living 

2 0 room) remote from a PC 2 desires to use the PC 2 at the 

TV receiver 4, the user may activate a function button 
located on input interface extender 26 at the user's 
viewing location, which button launches, i.e., 
transmits, programming instruction 72 through 
25 transmitter 22 along backchannel 21 (shown 
representatively as the AC wiring) to AC power outlet 23 
located in the vicinity of PC 2 . The signal is received 
from outlet 23 through receiver 42 at the input to PC 
interface unit 10. Within PC interface unit 10 the 

3 0 instruction or multiple instruction program is received 

and processed by microcontroller 34 to provide a signal 
to PC 2 or to activate a switch which restores PC 2 to 
active operation from a sleep mode or powered off 
condition. 

An additional instruction or multiple 
instruction program 72 may also be launched through a 
function button 70 to PC interface unit 10 and 
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transmitted to PC 2 through USB or other input interface 
lines through coplexor 36. Such programming 

instructions can then be used to modify the display- 
format of the video signal generated by PC 2 to permit 
5 improved viewing upon- TV receiver 4 . 

While operating, PC 2 provides video signal 
output as VGA output to processor 32 or directly to 
transceiver 12 as a composite television scan format 
signal (e.g. NTSC) . PC 2 also provides left and right 
10 audio channel data on "Audio" signal lines to processor 
32. The video and audio signals are distributed by 
processor 32 to PC display screen 2a and PC speakers 
(not shown) . Processor 32 provides control over the 
displayed video signal through zoom, pan, and scan 
15 inputs received through backchannel 21 from input 
interface extender 26. 

After processing, the video signal is converted 
from the scan format (e,g. VGA) used by the PC to a scan 
format (e.g. NTSC) which can be viewed upon a 
20 television. The converted PC display signal at the 
output of scan converter 40, or the composite (NTSC) 
television format signal output directly from the PC 2 
and the left and right audio signals are modulated for 
transmission by transceiver 12, transmitted through 
25 antenna 11 and then received at antenna 15 coupled to 
transceiver 14 at the location of TV receiver 4 . 

Alternatively, the transmitted signal from 
antenna 11 is received at antenna 52 at the input to 
head end unit 50 located at the head end of the local 
3 0 (e.g. household) cable system. The transmitted PC video 
display signal and any accompanying audio signals are 
received through antenna 52 and receiver 54, then 
modulated onto an available cable channel frequency by 
FAM 58 and provided to combiner 6 0 which combines the 
3 5 transmitted PC video display signal and any audio 
signals with the existing channel signals on the 
incoming cable 62 from the cable service provider and 
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provides the combined output on one or more cables 61 
which distribute the cable signals locally, such as 
within a house. 

At the television receiver 4, signals received 
5 from the PC through antenna 15 or cable 61 through set 
top box 76 are provided as baseband video signal 16 and 
audio left and right channel signals 18 to TV receiver 
4. Alternatively, transceiver 14 outputs radio 
frequency signals on one or more cables 25 which provide 

10 the PC video display signal and one or more audio 
channel signals to be displayed on the TV receiver 4 or 
output on one or more loudspeakers 2 0 incorporated into 
TV receiver 4 or coupled thereto. 

Viewing the PC generated video signal and 

15 listening to accompanying audio signals, if any, which 
are output on TV receiver 4, the user located at a 
viewing position near TV receiver 4 is able to operate 
any one of a plurality of available PC input devices 
shown representatively as keyboard 27a, mouse or 

20 pointing device 27b, joystick 27c, microphone 27d, or 
digital telephone 27e, to vary the video display and/or 
audio signal information. 

Using such input devices, the user provides 
input controlling the operations of the PC through input 

2 5 data transmitted to the PC via USB converter 6 8 and USB 

hub 64 onto backchannel 21 through modem 22. It will be 
appreciated by those skilled in the art that a full 
range of input methods are available to the user at the 
TV receiver location to permit the user to exercise full 

3 0 control over the PC 2 , including control over the 

operations of the PC hardware, its operating system, and 
any applications which are executed thereon. 

Input data transmitted from the input interface 
extender 26 is received at PC interface unit 10 through 
3 5 modem 42 and provided as inputs to coplexor 3 6 and 
multiplexor 38. When PC 2 has a USB input port, USB 
input can be provided as multiplexed input data on the 
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USB interface line shown through USB bus 3 0 from USB 
compatible devices located at PC 2 and from devices 27a. 
through 2 7e at the TV receiver location through USB hub 
64 . 

5 When either the PC 2 or PC location input 

devices 29a through 2 9d are not USB compatible, coplexor 
36 is used to individually receive input from various 
input devices 29a through 29d and individually multiplex 
data from each type of input device e.g. data from 

10 keyboard 29a, with data from the corresponding input 
device keyboard 27a, which is located at the TV receiver 
4. These "coplexed" outputs are transmitted from PC 
interface unit 10 to PC 2 on traditional dedicated input 
interfaces, which are shown representatively as "Mouse", 

15 "Keyboard", "Joystick", "Serial", and "Mic" . 

Using the present invention, a user located at 
TV receiver 4 has full control over the operations of PC 
2, although PC 2 is located remotely, i.e. beyond the 
normal reach of standard input interface lines. As a 

20 further example of operations, a user located at TV 
receiver 4 can command the PC 2 to execute a video 
conferencing application which then provides video 
signals generated by the PC from data received over a 
network (e.g. the Internet, or public switched telephone 

2 5 network) and provides related audio output to the user 

over speaker 20 or through telephone 27e. As a return 
signal for the video conference, the user may speak 
through telephone 27e and locally generate video signals 
by video camera 19 for transmission to other 
30 participants of the video conference. 

FIGS. 3a through 3d illustrate various physical 
configurations in which the interface extension system 
of the present invention may be embodied. FIG. 3a shows 
a physical implementation which is the same as that 

3 5 shown in FIG. Ic, wherein transceiver 14 and input 

interface extender 2 6 are located externally to the TV 
receiver 4 . 
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FIG. 3b shows another embodiment in which 
transceiver 14 and input interface extender 2 6 are built 
in to TV receiver 4. In this embodiment, a keyboard 27a 
may have either a wired or a wireless (e.g. infrared) 
5 connection with the input interface extender 26. 

FIG. 3c shows an embodiment of the invention in 
which PC signals are distributed to a plurality of TV 
receivers 4, each of which has an input interface 
extender 26 which transmits input data from devices 

10 (e.g. keyboards 27a) along backchannel 21 through PC 
interface unit 10 to PC 2 . In this embodiment, the PC 
video display signal, and left and right audio channel 
signals are transmitted via radio frequency or microwave 
frequency signals from PC interface unit 10 to head end 

15 unit 50 located at a head end of a incoming cable 62 
from a CATV provider. Signals received from PC through 
PC interface unit 10 are combined with the incoming CATV 
signals on cable 62 and distributed to multiple TV 
receivers through a plurality of cables 61 to RF input 

2 0 ports thereof. 

In this distributed transmission system 
embodiment of the present invention, video signals 
generated by PC 2 may be transmitted to users at each of 
the TV receivers 4, which video signals appear the same 
25 to all such users. However, such multiple location 
distribution is advantageously utilized in a system in 
which users located at each of the TV receivers 4 
provide input data which are recognized by PC 2 as being 
generated at different respective input interface 

3 0 extenders 26 at the locations of the respective TV 

receivers 4. Such system is utilized to execute game 
applications, for example, for which more than one 
player provides control inputs for controlling the 
execution of such game applications. Thus, by this 
35 distributed system embodiment of the invention, users 
located in different rooms at which a TV receiver 4 or 
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other display monitor^ is located, can interactively 

control the operation of a single PC 2. 

The USB standard transmission protocol provides 
for the affixing of USB identifiers to serial data which 
5 is generated by various input devices, e.g. keyboard 
27a. Therefore, input interface extenders 26 having 
such circuitry 68, which are located at respective video 
display devices, e.g. TV receivers 4, are capable of 
adequately tagging the data from input devices located 

10 at respective input interface extenders 26 so as to 
permit PC 2 to recognize the location from which such 
input data has been received and to control the 
operations of PC 2 in accordance therewith. 

As a further extension of the distributed 

15 system embodiment of the invention, PC interface unit 10 
can incorporate an adapter within processor 32, which 
adapter is used to generate multiple screen video 
displays from virtual video display information which is 
provided by PC 2 over the "VGA" output line therefrom. 

20 Multiple screen video adapters, such as those which are 
sold currently by Colorgraphic Corp., generate multiple 
screen video signals from a standard VGA video output 
display signal from a windowed, i.e. Graphical User 
Interface (GUI) display. Thus, the display screen data 

2 5 viewed by users at respective TV receivers 4 can be 

different for each user. In conjunction with providing 
such multiple screen video displays, PC interface unit 
10 can incorporate additional soundcard circuitry within 
processor 3 2 for providing coordinated audio signals for 

3 0 output on loudspeakers located at respective video 

display devices, e.g. TV receivers 4. Alternatively, PC 
2 can be reconfigured by the user with additional audio 
processing circuitry such as one or more soundcards, 
providing multiple monoaural or paired stereophonic 
3 5 audio signals from each soundcard, such that a single 
soundcard may be used to process audio signals for 
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output to more or more user sessions provided at 
respective TV receivers 4 . 

In addition, operating systems such as OS/2® 
and Windows® provide for mult i- tasking servicing of 
5 different applications on a single PC through a single 
common GUI . .In the distributed embodiment of - the 
present invention, the PC user interface can be said to 
be "multiplied", such that each user is capable of 
exercising control over the operations of PC 2 in an 
10 independently controlled interactive session. 

FIG. 3d shows another embodiment of the 
invention in which the transceiver 14 is incorporated 
into the TV receiver 4, but input interface extender 26 
is used as an auxiliary unit which is not built into the 
15 TV receiver 4 . 

FIG. 4 illustrates the flow of signals to and 
from PC 2 to TV receiver 4, video camera 19 and 
representative input devices including keyboards 27a, 
29a joysticks, 27c and 29c, and mice 27b and 29b. As 
20 shown in FIG. 4, video signals generated by PC 2 are 
converted from a VGA/ SVGA scan format by converter 4 0 
and transmitted with accompanying audio signals, if any, 
via radio frequency or microwave frequency via 
transceiver 12 or via power line (PL) modem 42 to a 
25 transceiver 14 located at the TV receiver. Those 
skilled in the art will understand that the video signal 
may be transmitted as a single composite video signal 
which includes chrominance and luminance content or as 
two separately modulated chrominance and luminance 
3 0 signals (denoted Y/C) for improved image quality. In 
such case, transceivers 12 and 14 will be constructed to 
transmit and receive chrominance and luminance signals 
on two channels. As shown in FIG, 4 video signals 
generated by camera 19 are transmitted via transceiver 
35 14 via radio frequency, microwave frequency or power 
line transmission to transceiver 12 or modem 42 located 
in PC interface unit 10. The video signal received at 
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PC interface unit 10 is then provided as input 
information to PC 2 . 

As further shown in FIG. 4, data from input 
devices located at a viewing location the TV receiver 4, 
5 including keyboard 27a, pointing device, i.e. mouse 27b, 
and joystick 27c are multiplexed through multiplexor 64 
which may be, for example, a USB hub, and are 
transmitted via modem 22 via radio frequency, microwave 
frequency or power line transmission on backchannel 21. 

10 At the PC interface unit 10 the multiplexed input data 
is received from backchannel 21 through modem 42. As 
further shown in FIG. 4, when PC 2 does not contain a 
USB interface, or when input devices located at PC 2 
including PC keyboard 2 9a, mouse or pointing device 2 9b, 

15 and joystick 29c are not USB compatible, the data from 
each such input device located at the TV and each 
corresponding input device located at the PC 2 must be 
"coplexed" for input to PC 2. This operation is shown 
as the demultiplexing of the transmitted input data by 

20 DEMUX 38 at the inputs to coplexor circuits 36a, 36b, 
and 36c used to coplex keyboard, pointing device and 
joystick data, respectively for input to PC 2 . 

In still another embodiment of the invention, a 
system is provided wherein a television signal can be 

25 viewed upon TV receiver 4 in conjunction with a video 
signal generated by PC 2 , together with accompanying 
audio signals, when present, from data related to the 
television transmission. As shown in FIG. Ic a set top 
box 7 6 is coupled to the local cable 61 and provides 

3 0 output as one or more cable channel signals to 
transceiver 14. Alternatively, set top box 76 may be 
connected only to the local cable 61 and have an output 
connection to TV receiver 4 . 

Set top box 76 includes digital signal 

35 processing circuitry for extracting a "Universal 
Resource Locator" address which is transmitted during a 
blanking interval, e.g. the vertical blanking interval 
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or a horizontal blanking interval of a television 
transmission. The extracted URL address is provided on 
a signal line 78 to input interface extender 2 6 which 
modulates the URL signal via modem 22 for transmission 
5 via radio frequency, microwave frequency or power line 
transmission on a backchannel 21 to PC 2 through PC 
interface unit 10. 

PC unit 10 uses the URL address to access data 
related to the television transmission and, after such 

10 access is obtained, provides the accessed data as video, 
audio, or other information signal via transceiver 12 or 
modem 42 to the transceiver 14 and/or input interface 
extender 26. Data in the foirm of video signals are 
provided to TV receiver 4 through transceiver 14 . The 

15 related PC data signal is then available for viewing by 
the user as a picture-in-picture format signal on a TV 
receiver which has such capability, or alternatively, 
can be viewed selectively in conjunction with the 
television transmission at the touch of a button on a TV 

20 receiver control device or input interface extender 26. 
Input interface extender 26 may also provide rapid and 
direct switching between the standard television 
transmission and the related PC generated signal. 

Although the invention has been described 

2 5 herein with reference to particular preferred 

embodiments, it is to be understood that these 
embodiments are merely illustrative of the aspects and 
features of the invention. As such, it may be obvious 
to a person skilled in the art to make numerous 

3 0 modifications to the illustrative embodiments described 

herein. Such modifications and other arrangements which 
may be devised to implement the invention should not be 
deemed as departing from the spirit and scope of the 
invention as described and claimed herein 

35 
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WHAT IS CLAIMED IS: 

1. A system for extending the user interface 
of a computer to the location of a television (TV) 
receiver remote f-rom said computer, said user interface 
5 comprising a video display at said computer and an input 
interface at said computer responsive to user actuation 
for effecting changes in said video display, said system 
comprising: 

(a) a scan converter for converting signals 
10 representing said video display from a scan format 
utilized by said computer to a scan format utilized by 
said TV receiver to permit at least portions of said 
video display to appear on said TV receiver as a TV 
display; 



15 



(b) a transmitter for transmitting signals 
between said computer and said TV receiver; and 

(c) an input interface extender for connection 
to user input devices, said input interface extender 
receiving input signals for transmission to said 
computer to effect changes in said TV display. 

2. The system of Claim 1 wherein functions of 
said computer not requiring manual interchange of 
storage media are operable from said TV receiver 
location through said input interface extender. 

3. The system of Claim 1 wherein said input 
interface extender comprises means for transmitting said 
.nput signals over wire conductors to said computer. 

4. The system of Claim l wherein said input 
xnterface extender comprises means for transmitting said 
xnput Signals to said computer by utilizing 
electromagnetic radiation 

35 
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5 . The system of Claim 1 wherein said input 
interface extender comprises means for transmitting said 
input signals over AC wiring. 

6. The system of Claim 1 further comprising 
means for receiving signals transmitted by -said 
transmitter and for converting said received signals to 
one or more input frequencies of said TV receiver for 
input to said TV receiver. 

7. The system of Claim 1 wherein said 
transmitter transmits signals from said computer to a 
head-end location for distribution and coupling to said 
TV receiver. 

8. The system of Claim 7 wherein said scan 
converter produces a converted signal that is 
transmitted by electromagnetic radiation to said 
head-end location . 

9. The system of Claim 7 wherein said 
electromagnetic radiation is a radio frequency 
transmission. 



25 
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10. A system for multiplying the user 
interface of a computer to provide multiple, 
simultaneous, independently controlled interactive 
sessions to users located at each of a plurality of 
video display systems, said user interface comprising a 
video display at said computer and an input interface at 
said computer responsive to user actuation for effecting 
changes in said video display, said system comprising: 

(a) a transmitter for transmitting signals 
representing said video display between said computer 

^5 and said plurality of video display systems; and 

(b) a plurality of input interface extenders 
located at each of said video display systems for 
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connection to user input devices, said input interface 
extenders providing input signals to said computer for 
effecting changes in each respective video display- 
appearing on said video display systems . 

5 

11. The system of Claim 10 wherein each of 
said input interface extenders includes means for 
affixing an identifier to data received from user input 
devices connected thereto to permit said computer to 

10 distinguish said input signals among said input 
interface extenders • 

12. The system of Claim 10 wherein at least 
one of said video display systems is a television (TV) 

15 receiver and said system further comprises a scan 
converter for converting signals representing said video 
display from a scan format utilized by said computer to 
a scan format utilized by said TV receiver to permit at 
least portions of said video display to appear on said 

20 TV receiver as a TV display. 

13 . The system of Claim 1 wherein said input 
interface extender further comprises means for storing 
at least one multiple instruction program executable by 

2 5 said computer to provide control over the operations of 
said computer . 

14 . The system of Claim 13 wherein said 
program controls a video display processor to configure 

^0 said video display for improved viewing on said TV 
receiver . 

15. The system of Claim 13 wherein said input 
interface extender further comprises user-actuable means 

35 for causing said program to be executed by said computer. 
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16. A system for permitting a television (TV) 
transmission to be viewed in association with a 
computer -generated video display signal on at least one 
TV receiver located remote from said computer, said 

5 system comprising: 

(a) means for extracting an address embedded 
in said TV transmission, at which data related to said 
TV transmission is accessible by said computer; 

(b) activation means responsive to input at 
10 said remote TV receiver for causing said computer to 

access said related data using said extracted address; 

(c) a scan converter for converting said 
computer-generated video display signal to a scan format 
utilized by said TV receiver to permit said 

15 computer-generated video display sign to appear on said 
TV receiver; and 

(d) a transmitter for transmitting signals 
between said computer and said TV receiver. 

17. The system of Claim 16 further comprising 
means for receiving signals transmitted by said 
transmitter and for converting said received signals to 
one or more input frequencies of said TV receiver for 
input to said TV receiver. 

25 

18. The system of Claim 16 wherein said 
transmitter transmits signals from said computer to a 
head-end location for distribution and coupling to said 
TV receiver. 

30 

19. The system of Claim 16 wherein said scan 
converter is located at said computer location and 
produces a converted signal that is transmitted by 
electromagnetic radiation to said head-end location. 

35 

20. The system of Claim 16 further comprising 
user-actuatable means located at said TV receiver for 
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displaying said transmitted computer-generated video 
display signal in picture- in-picture format with said TV 
transmission on said TV receiver, 

21. The system of Claim 16 further comprising 
user-actuable means located at said TV receiver for 
automatically displaying said computer-generated video 
display signal on said TV receiver. 

22. The system of Claim 16 further comprising 
means located at said TV receiver for indicating when 
said computer-generated video display signal is 
available. 
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